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ABSTRACT 


This  report  presents  an  evaluation  of  the  systematic  error  of  the  Naw 
Operational  Global  Atmospheric  Prediction  System  t NOGAPS  2.1)  for  the  winter 
of  1983/84.  The  systematic  error  is  just  the  mean  of  the  forecast  error.  The 
error  is  the  difference  between  the  NOGAPS  forecast  and  the  NOGAPS  anal  vs is  at 
verification  time.  The  fields  examined  are  the  925,  500  and  250  mb  heights, 
the  925  and  250  mb  winds,  the  925-500  mb  thickness  and  sea-level  pressure. 
The  forecasts  are  those  started  on  the  0000  GMT  watch  for  120  h  anu 
evaluated  at  intervals  of  24  hours.  The  error  and  analysis  fields  are  also 
Fourier  decomposed  along  latitude  circles  to  ascertain  the  scale  structure  of 
the  errors. 

In  addition,  anomaly  correlations  and  root  mean  square  err'"-  are 
computed  over  various  latitude  bands  to  provide  an  overview  of  the  mot-i 


norformanee. 


1.  Introduction: 

This  is  a  summary  report  on  the  performance  of  the  NOGAPS  model  for  the 
winter  of  1983/84.  The  results  are  presented  chiefly  in  terms  of  mean  monthiv 
charts  of  systematic  error  and  by  graphs  of  anomaly  correlation.  The 
discussion  focuses  on  the  month  of  January  1984  since  NOGAPS  2.1  data  for  this 
month  was  the  most  complete  of  the  winter  months  (winter  =  Dec,  Jan,  Feb  . 
The  data  used  were  exclusively  from  the  forecast  started  at  0000  GMT  since 
these  integrations  extended  to  120  h. 

2.  January  1984 

a.  500  mb  Heights 

Fig.  lA  is  a  chart  of  the  monthly  mean  0000  GMT  500  mb  NOGAPS  analyses 
for  January  1984.  The  pattern  is  fairly  typical  compared  to  longer  *  -  *  m 
averages.  The  major  anomaly  for  the  month  is  the  verv  strong  flow  ui  .  ?  in 
North  Atlantic  due  to  a  negative  anomaly  north  of  SON  and  a  posLti'-e  unmai' 
south  of  this  latitude.  A  secondary  anomaly  was  strong  ridging  alone  LfJlv. 
the  western  edge  of  North  America.  The  anomaly  patterns  for  TOO  mb  ir 

presented  bv  Quiroz  ( 1984  . 

rig.  IB  is  the  systematic  error  of  the  24  h  forecasts  of  ‘a  •  m 

•eoputential  for  the  0000  GMT  runs  for  January  1984.  The  systematic  r> ■: 
defined  as: 

r.  _  1  Zfcc.t  -  Zobs 

Zsy*  -  ^  - 

where: 

/■our,  •-  NOGAPS  0000  GMT  analysis 


Zrnr.T 


Forecast  valid  at  the  observation  time 


(~)  =  average  over  all  the  available  forecast/observation  pairs 

for  a  given  forecast  projection 

N  =  number  of.  forecast/analysis  pairs  available  for  given 

forecast  projection. 

As  expected,  the  24  h  NOGAPS  forecasts  are,  in  general,  quite  credible. 
There  are  obvious  problems  apparently  associated  with  the  high  terrain  of  the 
Tibetan  Plateau  (TIP)  and  Greenland.  There  is  a  less  prominent  error  in  the 
regions  of  the  Rockies  and  Alaskan  Range.  The  pattern  is  similar  to  that  of 
the  NMC/ECMWF  errors  at  24  hours  documented  by  Bettge  '1983)  rhis  Fig.  1  for 
the  1080/81  winter.  Specifically,  areas  of  agreement  with  Bettge’?.  r«*sui t «•: 
are  the  prominent  negative  error  over  the  TIP  and  to  its  east,  and  over 
Alaskan  Range.  Magnitude  of  this  error  pattern  in  all  three  models  :  . 
comparable.  Bettge  attributes  this  error  to  incorrectly  handled  oroRf>-  ;u  ■ 
forcing.  There  are  notable  differences  in  the  500  mb  height  errors  in  :.e 
subtropics.  Bettge  : 19831  found  distinct  positive  error  centers  ■•>r 

Indochina  and  the  eastern  North  Pacific  Ocean.  In  constrast,  NOGAPS  errors 
are  positive  but  not  major  features  of  the  pattern. 

Fig.  1C  is  a  chart  of  the  northern  hemisphere,  500  mb.  geopot  cut  i ;>  i 
svs»  emat  ic  error  for  the  72  h  forecast.  Over  a  large  part  of  Mie  ch,:i" 

72  hour  error  represents  a  growth  of  the  24  h  pattern,  although  the  i . trite 
error  over  the  TIP  has  remained  remarkably  constant.  There  are  large  negative 
errors  (forecast  too  low)  over  the  TIP,  Gulf  of  Alaska  and  Western 
Europe/North  Atlantic,  and  large  positive  errors  east  of  Japan  and  over 
eastern  North  America.  There  is  a  general  tendency  of  positive  error  north  of 
G0N  with  the  exception  of  Greenland.  The  errors  along  the  winter  storm  treks 
North  Pacific.  North  Atlantic  have  grown  substantially  as  have  the  erre  rr 
over  the  "cold  poles"  of  Eastern  Siberia  and  North  Central  Canada.  These 


positive  polar  errors  are  consistent  with  forecaster  observations  of  upper- 
level  flow  which  is  excessively  zonal  and  weak  in  longer  range  NOGAPS 
forecasts.  In  the  exit  region  of  the  anomalously  strong  flow  over  the  Nor'h 
Atlantic  there  is  a  substantial  negative  error  centered  at  55N,  20E  over 
Northern  Europe, 
b.  Thickness  ,925  to  500  mb) 

Fig.  2A  is  the  mean,  monthly,  925-500  mb  thickness  for  the  0000  GMT 
analyses  for  January  1984  and  Fig.  2B  is  the  systematic  error  of  this  quant  it  - 
for  the  72  h  forecasts.  Negative  values  (positive  values!  indicate  regi c.ns 
where  the  forecast  is  too  cold  (warm).  A  15  m  error  in  this  thickness  :  - 
equivalent  to  a  0.85  K  error  in  the  column  mean  temperature.  Frommem 
negative  regions  are  the  North  Atlantic  and  western  North  Pacific  Ocean, 
forecast  is  too  warm  over  Japan,  eastern  North  America  and  Eastern  Siberia. 
Eastern  North  America  is  anomalously  cold  for  this  month  Quiroz.  i'J34  . 

Fas  tern  Siberia  is  anomalous lv  warm.  Comparing  Figs.  2A  and  2B  *  here  .*  ; 

tendenev  for  the  model  to  be  too  warm  in  the  regions  of  the  Eastern  SiLeri  m 
and  Canadian  "cold  poles." 

Fig.  2C  is  a  Fourier  decomposition  of  the  data  from  Fig.  2B.  retains. • 
cast  the  planet arv  scale  waves,  zonal  wave  numbers  l,  2  and  h.  hi  •. 
presented  in  an  attempt  to  isolate  anv  problems  forced  bv  land /sea  heat  in.: 
contrasts  which  in  the  Northern  Hemisphere  probablv  force  this  scale.  I'roadiv 
speaking,  Fig.  2C  shows  that  north  of  30N  the  eastern  oceanic  basins  are  '  oc> 
cold  and  the  eastern  continental  regions  are  too  warm.  A  similar  error 
pat  tern  was  documented  for  the  earlier  NMO  PE  model  bv  Wallace  and  Woessmr 
L9M1  .  Ti.e  warm  pocket  thrusting  east  of  Japan  contrasts  with  ■  !i“  r*->>rs 

i  long  e;is*ern  North  America  which  parallel  the  coastline.  the  p<>i  m  ns 

north  of  FON  are  everywhere  too  warm. 


c.  Sea- Level  Pressure 

Fig.  3A  is  the  monthly  mean  sea-level  pressure  for  the  January  1984 
0000  GMT  analyses.  Fig.  3B  is  the  72  h  systematic  forecast  error  of  sea-level 
pressure.  The  lows  in  the  Gulf  of  Alaska  and  over  Iceland  are  forecast  to<> 
low,  while  the  ridging  off  the  southeast  Asia  coast  is  underforecast.  The 

large  negative  error  pattern  in  the  North  Pacific  and  North  Atlantic  Oceans  is 
likely  associated  with  the  NOGAPS  tendency  not  to  fill  mature  lows  fast 
enough.  Also,  FNOC  meteorologists  have  noted  that  NOGAPS  will  forecast  North 
Pacific  Ocean  mature  lows  to  move  inland  erroneously.  The  large  negative 
error  over  Alaska  is  associated  with  this  tendency.  NOGAPJS  has  a  1  ender.e'-  to 
move  continental  highs  offshore  in  east  Asia  too  slow.  This  error  is  Lik>dv 
coupled  to  the  underforecast  of  ridging  over  the  Asian  coast.  There  is  a 
major  negative  forecast  error  center  over  Europe  under  the  500  mb  diffluent 
region.  This  low  SLP  forecast  compensates  the  low  500  mb  forecast  a..<:  ref  n 
in  a  small  thickness  error  in  this  region.  There  are  relativ  >v  smut  L  ><  a 
level  pressure  errors  in  the  polar  regions.  Almost  the  entire  Asian  continent, 
north  of  30N  displays  a  negative  error. 

d.  Wind  Fields  250  and  925  mb 

Fig.  4A  is  the  monthly  mean  925  mb  wind  field  and  Fig.  iP.  :s  !!;■• 
systematic  error  of  the  field  at  72  hours.  The  scale  of  the  wind  vein's  are 
in  the  upper  right  -hand  corner  of  the  plot.  The  number  corresponds  ‘  o  the 
speed  to  which  a  vector  of  10°  longitude  in  length  corresponds.  All  t  he 
vector  lengths  are  scaled  accordingly.  Thus,  if  the  scale  is  30  ms~  1  ,  *  hen  a 
vector  representing  40  ras~l  would  be  5°  of  longitude  in  length.  Tin-  error 

f:  -.'Id  shows  coherent  circulation  patterns  which  hopeful  lv  will  t  -<  :  1  .  c 
i  den  t  i  float  ion  and  correct  ion  of  error  sources  upon  further  .m.-uve 


error  pattern  is  in  approximate  geostrophic  balance  with  the  sea-level 
pressure  error  of  Fig.  3B. 

There  appear  to  be  circulation  errors  along  the  equator  in  the  regions 
of  the  mean  convection  centers,  Indonesia,  Brazil  and  equatorial  Africa.  The 
Australian  monsoon  flow  onto  the  continent  is  somewhat  underforecast  as  it  is 
in  South  America  and  Africa.  The  northeasterly  monsoon  flow  off  the  southeast 
Asian  land  mass  is  also  a  region  of  prominent  error.  The  strong  southerly 
flow  indicated  just  south  of  Japan  in  Fig.  4B  is  consistent  with  (and  perhaps 
an  underlying  cause  of}  the  warm  error  in  the  thickness  field.  Similar lv. 
southerly  flow  over  Hudson’s  Bay  in  Fig.  4B  is  also  associated  witu  rest'  > 
thickness  errors.  Both  may  be  an  indication  of  model  failure  to  develop  cold 
polar  anticyclones.  An  anticyclonic-error  circulation  is  centered  in  northern 
Mexico,  yielding  strong  southerly  flow  off  the  Baja  coast.  There  ar  > 
erroneously  strong  westerlies  from  Spam  eastward  into  Asia. 

Fig.  5 A  is  the  monthly  mean  200  mb  wind  analysis  for  Januarv  ».  a  . 
Fig.  5B  is  the  72  h  systematic  error.  As  in  the  lower-level  wind  -id. 
errors  at  200  mb  appear  to  be  coherent  circulation  patterns  in  the  rt  i 
fields.  Some  of  the  most  prominent  errors  occur  over  ‘tic  oceanic  :•■■■  . 
where  the  data  are  sparse,  t  bus  it  is  difficult  to  assess  *  -cue  . 
However,  at  250  mb  and  925  mb  also'  the  use  of  satellite  and  aircraft  nv'i1; 
make  this  level  one  with  the  most  reliable  wind  analyses  m  oceanic  regions. 

In  midlatitudes  there  is  an  apparent  relation  between  the  site  err  a s 
and  the  axis  and  exit  regions  of  the  North  America  and  east  Asian  jet  maxima. 
There  is  a  definite  underforecast  of  the  ridge  on  the  North  America  oast  . 
with  a  cyclonic  error  circulation  in  the  Gulf  of  Alaska.  The  <■  i  r-  u  I  a  t  i  ■  >r 
oat  tern  of  eve  Ionic  error  just  over  the  southern  .Japanese  Is!  mils  imaht  be 
indication  that  the  jet  maxima  is  forecast  too  far  north. 


In  the  tropics  the  Australian  monsoon  circulation  is  a  region  of 
prominent  error  with  an  anomalous  anticyclonic  circulation  over  the  continent. 
The  tropics  have  some  large  percentage  errors  relative  to  the  mean  flow.  For 
example,  the  weak  flow  off  the  eastern  South  American  coast  near  the  equator 
is  a  region  of  error  comparable  to  that  of  the  midlatitude  jet  regions  where 
the  mean  flow  is  quite  small.  The  errors  in  the  tropics  are  not  restricted  to 
the  climatological  convectively-active  regions, 
e.  Hovmuller  Plots  500  mb  Geopotential 

Fig.  6A  is  a  time- longitude  (Hovmulleri  plot  of  the  0000  GMT  analyzed 
500  mb  geopotential  for  January  1084.  The  values  are.  averages  ever  ‘'lit 
latitude  band  from  30N  to  60N.  Fig.  6A  presents  the  deviations  of  the  Height 
field  from  its  zonal  mean  for  the  total  field  while  Fig.  6B  is  the  same  fiei  ! 
only  for  the  zonal  wave  numbers  1,  2  and  3.  In  both  charts  the  positions  of 

the  troughs  dashed  lines  and  ridges  solid:  corresponding  to  Fig.  1A  .a  • 

quite  clear. 

Figs.  7A  and  ?B  are  the  same  plots  as  in  Figs.  BA  and  rip.  hut  fot  '  '  a 

forecasts  of  NOGAPS.  It  should  be  made  clear  that  this  is  not  a  cent  i nuous 

run  of  the  model  but  represents  26,  96  h  forecasts  all  starting  from  <1  i t for on ' 
initial  conditions.  NOGAPS  did  not  run  out  to  96  hours  on  the  10t:i  ami  2i.,‘ 
of  the  month  and  these  data  gaps  were  linearly  interpolated.  I ;  v •  -i i  '  m 
discontinuous  nature  of  these  model  runs,  the  smoothness  of  the  diagrams 
evidence  of  the  effectiveness  of  the  data  assimilation^ forecast  eyrie. 
Comparing  Figs.  6A  and  7A  and  6B  and  7B  one  finds  that  the  NOG  A  I’S  96  h 
forecast  is  quite  representative. 

Figs.  HA  and  HR  are  the  differences  FORECAST  OBSERVED  !>e»w*>e» 
Figs.  7  A  and  6A  and  7P,  and  BB.  There  does  not  appear  to  l”-  ,mv  :  am  i  *  ude 
which  is  blatantly  in  error  for  all  forecasts.  However,  forecast  problems 
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appear  centerd  near  150W  and  the  Greenwich  meridian  in  Fig.  8A,  and  150W,  60W 
and  Greenwich  meridian  in  Fig.  8B.  The  60W  and  OE  are  areas  where  there  is 
high  variability  in  the  pattern  fi.e.,  alteration  of  high  and  low  heights  . 
The  model  seems  fairly  skillful  in  the  region  of  the  standing  trough  at  i'OE. 
Comparison  of  Fig.  8B  with  8A  indicates  that  there  is  significant  error  in  the 
planetary  scale  waves. 

A  prominent  blocking  event  occurred  off  the  western  North  America  coast 
in  the  Gulf  of  Alaska  region  during  the  period  from  10  to  20  January  1984 
Quiroz,  19841 .  This  blocking  was  manifested  by  a  prominent,  persistent  ridno 
near  150W.  This  strong  ridging  is  especially  evident  in.  the  planetar'. 
diagram,  Fig.  6B.  Comparison  between  Figs.  6B  and  7B  shows  this  blocking 
ridge  is  evidently  handled  adequately  by  the  NOGAPS  model  at  96  hours.  There 
is  evidence  :  Fig.  8B)  of  a  model  tendency  to  underforecast  the  ridge  -_n<: 
perhaps  be  a  little  slow  in  its  formation  and  decay:  however,  the  essential', 
of  this  important  feature  are  clear  in  the  forecast. 

The  value  of  this  chart  Figs.  8A,B)  is  to  show  that  the  systematic 
error  patterns  of  the  preceding  figures  are  not  the  result  of  one  or  Mvo 
catastrophic  forecasts.  The  figures  indicate  that  the  systematic  ••rt-'rs  •  m 
the  result  of  a  sometimes  subtle  error  tendency  which  can  be  c<  m:.  ie:  ,■  1  v 
absent  or  reversed  on  any  given  single  chart.  The  systematic  errors  ■  an 
masked  by  other  developments  and  are  not  observed  as  a  constant  bias  at  -mv 
particular  location. 

Figs.  8A  and  8B  also  suggest  a  closer  analysis,  with  larger  time  series, 
of  periods  when  the  model  performed  poorly  and  when  it  performed  well.  There 
appears  to  be  a  t-*ndencv  for  errors  to  persist  through  i  number  ■>; 


for ecus t , anal  vs  is  c  ycles . 


It  would  be  of  value  to  de*  ermine  if  these 


are  "regime  oriented”,  that  is,  are  there  particular  flow  patterns  for  which 
the  model  can  be  expected  to  perform  poorly, 
f.  Anomaly  Correlations  . 

Fig.  9  is  a  graph  of  anomaly  correlation  coefficient  versus  forecast 
projection  for  500  mb  heights,  averaged  over  the  latitude  band  from  30N  to  SON 
for  January  1984.  The  anomaly  correlation  coefficient  (ACC)  is  defined  as  in 
Miyakoda  et  al.  (1972): 

^cc  =  Axf  it'  ■  Xo  (t) 

Axr  )z  <Ax0  )2 

where:  f  -  forecast  interval 

Ax:  r  =  x(r)  -  xc  :  xe  =  climatology 
Axr  =  forecast  anomaly  for  given  r 

:<o  =  analysis  anomalv 

-  spatial  average  over  all  equally  weighted  grid  points 

[  .  =  average  over  ail  the  forecast/analysis  pairs  for  the  month. - 

The  climatology  used  is  the  monthly  mean  field  from  the  available  NOG APS 
0000  GMT  analyses.  This  differs  from  the  common  practice  of  using  a  ioicer 
term  climatology  but  should  not  have  a  large  impact  on  the  actual  values  of 
the  ACC.  The  ACC  is  computed  for  the  Fourier  analyzed  fields.  These  spectral 

ACC’s  are  divided  into  bands  of  zonal  wavenumber  1  to  3,  4  to  7  and  8  to  12. 

Fig.  9  clearly  shows  that  the  planetary  scale  waves  achieve  the  best 
scores  at  all  forecast  projections,  with  their  advantage  growing  slightly  in 
time.  A  rule  of  thumb,  generally  accepted,  is  that  a  forecast  still  contains 
useful  information  if  its  ACC  is  above  0.6.  Using  this  criterion,  the 
planetary  wave  forecast  1,  2,  3  is  useful  in  this  latitude  band  out  to 


120  h.  The  shortest  waves  (8-12)  fall  below  this  value  at  72  h.  Fig.  9, 
compared  to  similar  plots  generated  by  NMC  and  ECMWF,  indicates  that  NOGAPS  is 
competitive  to  forecasts  produced  by  these  centers  but  generally  its  forecast 
deteriorates  at  a  more  rapid  rate.  NMC’s  planetary  wave  forecast  ACC  does  not 
fall  below  0.6  until  day  7  for  the  January  1984  period,  Ward  ; 19841. 

Fig.  10  is  the  same  as  Fig.  9  except  that  the  data  are  for  the  latitude 
band  0  to  30N.  In  this  band  the  planetary  wave  forecast  loses  its 
superiority,  and  the  forecast  deteriorates  more  rapidly  than  the  midlatitude 
band  of  Fig.  9.  All  wave  groups  fall  below  0.6  before  day  3. 

Fig.  11  is  a  time  series  of  the  ACC  for  the  month  of  January  L984  for 
the  midlatitude  band  i30N-60N)  for  72  h  forecast  of  500  mb  height.  There  are 
periods  of  good  and  bad  forecasts  as  previously  indicated  by  the  Hovmuller 
diagrams.  In  general,  the  planetary  scale  waves  are  superior  on  a  uuv-to-duv 
basis,  although  there  are  a  few  periods  where  they  fall  from  pre-eminence. 
There  are  some  catastrophic  svnoptic  scale  wave  forecasts,  but  the  av  - 
monthly  values  give  a  good  idea  of  the  day-to-day  performance.  Generali’.-,  ‘In- 
forecast  is  reliable  out  to  72  h.  It  might  be  of  some  value  to  investigate 
and  contrast  the  periods  during  which  the  model  performs  well  and  '  ii-  s. 
which  is  does  poorly.  This  is  a  topic  of  interest  to  the  ECMWF  Ben-. *  .•  ■  >u 
Simmons,  1983  . 

Fig.  12  is  the  same  as  Fig.  9  but  for  925-500  mb  thickness.  This  i:  i  \ 
a  measure  of  both  the  500  and  925  forecast  fields.  As  expected,  'here  is  - 
faster  falloff  in  this  figure  than  the  500  mb  ACC  since  the  errors  of  the  925 
fields  are  added  to  the  500  mb  error  and  evidently  they  are  correlated, 
g.  v!«*an  Thickness  Error  -  January  1984 

Fig.  L3A  is  a  plot  of  the  mean  error  of  the  925-500  mb  thickness  for  the 
polar  band  BON  to  85N'.  for  January  1984.  The  mean  error  is  positive 


(forecast  too  wars)  and  grows  rapidly  with  time.  On  the  average,  by  120  h  the 
925-500  mb  column  is  4  K  degrees  too  warm  in  the  NOGAPS  forecast.  Fig.  13B  is 
the  same  as  Fig.  13A  only  for  the  midlatitude  band  (30N-60N).  Again,  the 
error  is  positive  but  only  half  that  of  the  polar  band  at  120  h.  The  tropical 
band  (0-30N)  also  shows  a  positive  mean  error,  but  only  1.1  K  at  120  h.  The 
model  on  a  global  average,  and  by  bands,  has  a  problem  in  becoming  too  warm  in 
the  lower  troposphere.  Calculations  of  the  925-250  mb  thickness  error 
indicate  that  the  positive  bias  is  true  for  this  thickness  also. 

3.  Systematic  Errors  -  December  1983 

Figs.  14  through  21  are  the  figures  for  December  1983  corresponding  to 
Figs.  1  through  13  ( January  1984).  NOGAPS  version  2.1  became  operational  on 
8  December  1983  and  the  figures  are  the  forecast  data  from  8  December  1983 
through  31  December  1983. 

Fig.  14A  is  the  monthly  mean  500  mb  height  for  the  0000  GMT  \'OGAP-. 
analvses  for  December  1983.  A  very  prominent  feature  on  the  chart  r, 
ridge  centered  in  the  Gulf  of  Alaska.  This  anomalous  feature  is  the  result  of 
persistent  blocking  in  the  region  for  almost  the  entire  December  1983  period 
Quiroz,  1984).  The  effect  of  this  blocking  ridge  resulted  in  •  lie 
V.S.  experiencing  one  of  the  coldest  Decembers  on  record  Quiroz.  1 : m !  . 
Other  large  scale  features  of  the  500  mb  pattern,  particularlv  pronounced  >"■ 
wave  trough  activity,  over  east  Asia  &  eastern  North  America,  are  similar  to 
January  1984. 

The  systematic  72  h  error  of  500  mb  geopotential,  Fig.  14B,  indicates 
that  this  important,  persistent  pattern  was  handled  satisfactorily  bv  ’he 
model.  However,  the  west  coast  of  North  America  is.  however,  a  site  of 
rather  negative  significant  errors.  Common  error  patterns  between  .i.snua,  • 
1984  and  December  1983  include: 
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(i)  positive  error  south  and  east  of  Japan  (also  in  thickness), 

(ii)  positive  errors  over  the  polar  region  (also  in  thickness), 


(iii)  positive  errors. over  eastern  North  America  associated  with  the 
long  wave  trough, 

! iv )  negative  error  over  Europe  and  eastern  North  Atlantic  Ocean  with 
positive  error  couplet  to  the  south)  associated  with  diffluent 
flow. 

Another  aspect  of  these  problems  is  revealed  in  Fig.  15B  which  is  the 
925-500  mb  thickness  systematic  error  for  December  1983.  The  thickness  is 

clearly  too  high  over  almost  all  of  North  .America.  The  model  is  failing 
fully  capture  the  blocking-type  flow  that  characterized  the  month  and  led  ‘ 
very  cold  air  thrusting  southward  into  the  continent.  A  similar  tendency  on  a 
lesser  scale  was  observed  in  the  January  1984  data. 

The  December  1984  SLP  errors  that  are  similar  to  those  in  January  i'J84 

are 

i;  negative  8  to  12  mb  errors  over  Asian  continent  and  East  Asian 
coast, 

ii'  negative  4  to  8  mb  errors  over  Europe  and  east  of  iJreen  •  ,,nd 
associated  with  more  vigorous  cyclone  activity, 
iii  negative  errors  along  the  western  North  American  coast.  These 
errors  are  under  the  main  belt  of  westerlies,  suggesting  that  the 
erroneous  movement  of  cyclones  inland  contributes  to  this  error. 

The  remainder  of  the  December  1983  figures  will  not  be  discussed  in  any 
detail  for  the  sake  of  brevity.  Most  of  the  patterns  speak  for  themselves:  as 
tier*-  complete  data  sets  are  collected,  a  more  thorough  analyses  will  !»• 


ndertaken. 


4.  Systematic  Errors  -  February  1984 

The  data  available  for  February  84  were  limited  to  only  half  of  the 
month  ( 1  through  14  February  84).  The  flow  pattern  for  February  84  presents 
an  interesting  contrast  to  December  1983,  especially  over  North  America.  The 
strong  Gulf  of  Alaska  ridging  (blocking)  was  replaced  by  anomalous  troughing 
in  the  same  position.  A  prominent  ridge  developed  in  western  Asia  centered  at 
SON,  50E.  Fig.  22A  is  the  February  84  monthly  mean  500  mb  heights  from  the 
0000  GMT  analyses  (actually  only  using  1-14  February  1984  0000  GMT!.  The 
trough  over  Alaska  and  ridge  at  50E  are  prominent  features  (compare  to  Fig. 
14A,  December  1983).  Fig.  22B  is  the  72  h  error  for  the  500  mb  geopotent  lui 
for  February  1984.  The  error  pattern  is  similar  to  Fig.  14A,  December  1983, 
with  a  major  difference  being  the  large  positive  center  at  47N,  60F.  just 
north  of  the  Aral  Sea).  This  is  just  downstream  of  the  site  of  t  he 
anomalously  strong  ridging  for  the  month.  Despite  the  very  different  upstream 
flow  pattern,  the  error  pattern  over  North  America  is  surprisingly  like  !  n  i: 
of  December  1983  (Fig.  14B)  and  January  1984  (Fig.  1C).  This  suggests  that 
the  low  heights  over  North  America  are  a  result  of  physics  or  boundary 
problems  rather  than  dynamics. 

Fig.  23A  is  the  mean  925-500  mb  thickness  for  February  81  and  Fig. 
is  the  72  h  systematic  error  in  the  field.  Again,  there  is  a  great  deal  of 
similarity  to  the  error  pattern  of  December  1983  (Fig.  15B).  This  similarity 
is  apparent  over  North  America  despite  the  very  different  thermal  character  of 
(he  fields  over  North  America  for  these  two  months  (Quiroz,  1984). 

Fig.  23C  is  the  same  data  as  in  Fig.  23A  but  Fourier  decomposed  and 
retaining  only  the  planetary  scale  zonal  wave  numbers  1,  2,  3  .  The  o.attern 
can  be  generalized  bv  saying  that  the  eastern  and  southern  ocean  basins  are 


too  cold,  the  southern  and  east  coast  of  continents  are  too  warm  and 


everywhere  north  of  60N  is  too  wans.  The  region  of  anomalous  ridging  in 
western  Asia  is  a  center  of  warm  bias. 

The  similarity  of  the  patterns,  of  the  planetary  scale  72  h  error  if  the 
925-500  mb  thickness,  for  the  three  months  (Dec,  Jan,  Feb'  points  to  a  problem 
in  the  model  related  to  geographical  forcing  rather  than  a  "regime"  type 
error.  The  flow  regimes  for  these  months  (e.g.,  December  1983  and  February 
1984)  were  very  different,  yet  he  error  patterns  were  similar. 

5.  NOGAPS  2.0  -  Systematic  Error  -  November  1983 

An  enlightening  exercise  is  to  look  at  data  from  the  November  1983 
NOGAPS  forecasts  which  were  run  using  NOGAPS  version  2.0.  Fig.  25A  is  ♦  * ■ 
925-500  mb  thickness  for  the  month  of  November  1983  and  Fig.  25B  is  the  72  h 
forecast  error.  Contrasting  the  error  pattern  of  Fig.  25B  to  Fig.  15B 
'December  1983,  NOGAPS  2. 11  the  most  prominent  difference  is  over  and  to  ’he 
east  of  the  North  American  continent.  In  these  regions  the  sign  of  the  error 
:s  reversed.  The  error  sign  is  also  reversed  in  the  northern  huLf  ’ 
Asian  continent  but  the  magnitude  of  the  error  is  relatively  small.  The  warm 
center  south  of  Japan  is  a  feature  common  to  both  figures. 

Figs.  15C  and  250  depict  the  planetary  wave  error  in  the  72  h,  32“ 
•’>00  mb  thickness  field.  November  1983  (Fig.  25C  ■  has  a  tendency  for  1 ..  <  in 

to  be  too  cold  and  the  water  too  warm  while  December  1983  has  the  r-'.'M.ve 
features.  A  quantitive  comparison  is  hampered  by  the  fact  that  the  forcing'  d' 
the  two  months  is  different  and  in  December  the  polar  night  has  begun  north  of 
the  Arctic  circle.  But  perhaps  we  can  make  some  tentative  conclusions  about 
the  nature  of  the  NOGAPS  error  on  the  925-500  mb  thickness. 

\n  obvious  first  conclusion  is  that  the  NOGAPS  2.1  1’BI.  heat  transfer 
hanged  the  wav  the  atmosphere  gained  energy  and  perhaps  the  correction 
overshot  the  proper  value.  It  appears  that  the  new  version  has  altered  the 


air/sea,  land/sea  heat  exchange,  yet  the  prominent  positive  error  south  of 
Japan  is  coanon  to  both  months.  This  might  indicate  that  this  error  is  not 
due  to  the  improper  handling  of  the  air/sea  fluxes  over  the  Kuroshio  but 
perhaps  a  downstream  effect  of  improper  inclusion  of  the  TIP  effects. 

The  warm  continents,  especially  in  December  and  January,  might  be  due  to 
incorrect  calculation  of  the  radiative  transfer.  A  similar  conclusion  was 
reached  by  Wallace  and  Woessner  (1981)  when  they  observed  a  similar  error  in 
the  NMC  PE  model. 

6.  Summary  and  Conclusions 

An  investigation  of  forecasts  errors  by  the  Navy __  Operational  Global 
Analysis  and  Prediction  System  (NOGAPS  )  has  been  presented.  NOG APS  Lee  am** 
operational  in  late  1981  with  forecasts  from  an  improved  nine  layer  version 
commencing  December  1983.  The  current  verification  study  uses  data  prrmnri:. 
from  the  updated  version  and  focuses  on  winter  1983-84  forecasts  of  up  to 
days . 

A  vanetv  of  forecast  verification  statistics  have  been  examined  for  the 
three  winter  months.  Anomaly  correlations  for  NOGAPS  500  mb  geopotential  show 
similar  characteristics  to  ECMWF  and  NMC  results  with  planetary  wave  forerun;  •, 
showing  the  most  skill  in  raidlati tudes .  Monthly  systematic  error  ’.nnivses 
have  been  prepared  for  500  mb  height,  1000-500  mb  thickness,  sea  !->vi 
pressure  and  925  and  250  mb  wind  fields.  Hovmuller  diagrams  of  forecast  error 
show  the  temporal  distribution  of  errors  which  comprise  the  monthly  systematic 
error.  Nonsystematic  error  (Wallace  &  Woessner,  1981'  also  has  been  computed 
for  the  same  variables. 

Preliminary  analysis  reveals  repeatible  systematic  height  ••rrorc 
associated  with  the  elevated  terrain  of  the  Tibetan  Plateau,  Hockv  Mountains 
and  Greenland.  Systematic  thickness  errors  indicate  the  forecast  atmosphere 


is  too  cold  over  warn  oceanic  currents.  Large  errors  in  the  925  mb  wind 
fields  have  been  isolated  near  the  southern  tip  of  Greenland  and  over  the 
South  China  Sea  in  the  region  of  northeast  monsoon.  Future  efforts  will  be 
directed  toward  studying  the  1984  summer  model  errors.  Whenever  possible, 
NOGAPS  error  structures  will  be  compared  to  verification  results  of  other 
global  prediction  systems. 
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Monthly  mean  500  mb  geopotential  analysis  for  Jan  1984.  Data  for  the 
mean  were  the  0000  GMT  NOGAPS  analyses.  Contour  interval  is  60  m. 
Systematic  error  for  500  mb  geopotential  for  Jan  1984  for  Tau  -  24. 
Contour  interval  is  10  m.  Dashed  lines  indicate  negative  values,  solid 
lines  indicate  positive  values. 

As  in  IB  except  for  Tau  =  72  hours.  Contour  interval  is  20  m. 

Monthly  mean  925-500  mb  thickness  analysis  for  Jan  1984.  Data  for  the 
mean  were  the  0000  GMT  NOGAPS  analyses.  Contour  interval  is  60  m. 
Systematic  error  for  925-500  mb  thickness  for  Jan  1984  for  Tau  -  “2. 
Contour  interval  is  15  m.  Dashed  lines  indicate  negative  values,  solid 
lines  indfcate  positive  values. 

Planetary  scale  systematic  error  for  925-500  mb  thickness  for  Jan  1184 
for  Tau  =  72.  Fourier  decomposition  of  the  data  from  Fig.  2D  retaining 
only  zonal  wavenumbers  1  to  3.  Contour  interval  is  15  m.  Dashed  lines 
are  negative  values,  solid  lines  are  positive  values. 

As  in  Fig.  1A  except  for  sea  level  pressure.  Contour  interval  is  !  nib. 

As  in  Fig.  IB  except  for  sea  level  pressure.  Contour  interval  is  2  nib. 

Monthly  mean  925  mb  wind  field  for  Jan  1984.  Data  for  the  mean  were  the 
0000  GMT  NOGAPS  analyses.  Scale  for  the  wind  vector  is  on  the  upper 
right  top  of  the  figure. 

Systematic  error  for  the  925  mb  wind  for  Jan  1984  for  Tau  =  72  hs. 
Scale  for  the  wind  vector  is  on  the  upper  right  top  of  the  figure. 

As  in  Fig.  4A  except  for  the  250  mb  wind. 

As  in  Fig.  IB  except  for  the  250  mb  wind. 
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Time  versus  longitude  plot  (Hovmuller  diagram)  for  the  500  mb 
geopotential  for  Jan  1984.  The  data  plotted  are  average  values  for  the 
latitude  band  from  30N.  to  60N.  The  contour  interval  is  60  m. 

As  in  Fig.  6A  except  for  the  planetary  scale  waves,  zonal  wave  numbers  1 
to  3.  Contour  interval  is  60  m. 

As  in  6A  except  for  the  Tau  =  96  forecasts.  Contour  interval  is  60  in. 

As  in  6B  except  for  the  Tau  =  96  forecasts.  Contour  interval  is  60  m. 

As  in  6A  except  for  the  Tau  =  96  forecast  error  (FORECAST  -  OBSERVED!. 
Contour  interval  is  60  m. 

As  in  6B  except  for  the  Tau  =  96  h  forecast  error.  Contour  interval  is 
30  ra. 

Average  anomaly  correlation  for  500  mb  geopotential  for  a  latitude  band 
from  SON  to  60N  for  Jan  1984  for  forecast  projections  out  to  123  he. 
The  SI  =  planetary  waves  (1,  2,  and  31,  •  =  total,  *  -  long  waves 

4,  ",  6,  and  7!  and  -  synoptic  waves  >8  to  15'. 

As  in  Fig.  9  but  for  the  latitude  band  30N  to  the  equator. 

Anomaly  correlation  for  72  h  forecasts  for  the  month  of  Jan  1984  for  the 
500  mb  geopotential  average  over  the  latitude  band  30N  to  60N.  The 
values  on  the  extreme  right  hand  side  'day  -  22;  are  the  monthly  means 
seen  in  Fig.  9.  £3  =  planetary  waves,  e  “  total,  *  -  long  waves  ind 

-  synoptic  scale  waves. 

As  in  Fig.  9  but  for  the  925-500  mb  thickness. 

Mean  error  for  the  925-500  mb  thickness  for  the  latitude  band  60N  to  85  N 
for  Jan  1984. 

As  in  Fig.  13.4  except  for  the  latitude  band  60N  to  JON. 

As  in  Fig.  13B  except  for  the  latitude  bund  30N  to  equator. 

As  in  Fig.  IA  except  Dec  1982.  Contour  interval  is  60  m. 
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